The Design of a Performance Simulation System for Virtual Reality

We have developed a software framework for the creation of live performance simulations by non-technologists. This is a toolkit for simulating various types of cultural performances using motion capture, 3D animation, virtual reality, and reactive agents. The software allows the developer to define the components of a performance such as actors, audience members, and venue using a standard score paradigm. The user interactions and reactive agent scripting can also be defined through this interface. The developer can link hypermedia content to actions and objects in the performance and audience to provide further context for the user. The user can not only view the performance, but can interact with agents in the virtual world. To show the power of this technology, the team simulated several acts from a vaudeville performance in 1890’s New York City including comedy and strongman performances. In addition, the hypermedia engine provides historical facts, documents, and primary sources to provide research materials for viewers.